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(54) Image data processing devices and methods 



(57) After a preprocess such as a process for ex- 
tracting a portion of an image is performed by a preproc- 
essing unit for an image such as a barcode, etc., which 
is obtained (1) by an image data inputting unit within a 
first device such as a cellular phone equipped with a 
camera, etc., the image is transmitted (2) to a second 



device such as an image processing server, etc. via a 
communications path by an image data transmitting 
unit, in the second device, an Image process (3, 4) such 
as barcode data decoding, etc. is performed, and result 
data is notified (5) to the first device via the communi- 
cations path. 
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(54) Image data processing devices and methods 



(57) After a preprocess such as a process for ex- 
tracting a portion of an image is performed by a preproc- 
essing unit for an image such as a barcode, etc., which 
is obtained (1) by an image data inputting unit within a 
first device such as a cellular phone equipped with a 
camera, etc., the image is transmitted (2) to a second 



device such as an image processing server, etc. via a 
communications path by an image data transmitting 
unit. In the second device, an image process (3, 4) such 
as barcode data decoding, etc. is performed, and result 
data is notified (5) to the first device via the communi- 
cations path. 
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Description 

[0001] The present invention relates to an image data 
processing device having an image input device, and 
more particularly, to a portable device that can be used 5 
with an image input device such as a camera, or the like, 
and a communications path. 

[0002] In recent years, the use of the Internet by 
means of a cellular phone, a PDA (Personal Digital 
Assistant) , etc. has been increasing, and a cellular 10 
phone, a PDA, etc., which are quipped with an image 
input device such as a camera, etc. have been devel- 
oped. 

[0003] To read coded data such as a barcode, a two- 
dimensional barcode, etc., a terminal called a dedicated is 
barcode reader is used. 

[0004] _ Fig. 1 exemplifies the configuration of a con- 
ventional image input processing device such as a bar- 
code reader, etc. 

[0005] An image input processing device 10 such as 20 
a barcode reader, etc. comprises: an image data input- 
ting unit 11 reading a barcode image; an image data 
processing unit 12 receiving the read image from the 
image data inputting unit 11, and performing a process 
for the image data; and a process result outputting unit 25 
13 receiving a process result from the image data 
processing unit 12. 

[0006] After binarizing the read barcode image, the 
image data processing unit 1 2 performs area extraction 
to only take out the barcode portion. Then, the image 30 
data processing unit 12 extracts the data possessed by 
the barcode by decoding the barcode, and inputs the 
extracted data to the process result outputting unit 13 
as coded data. 

[0007] The barcode reader performs an image proc- 35 
ess and a decoding (extraction) process for the barcode 
data for the barcode image obtained with the camera, 
and finally outputs the coded data stored in the barcode. 
For these processes, an MPU the throughput of which 
is relatively high, or a dedicated LSI, and software which *o 
performs a process specific to a barcode image are re- 
quired. 

[0008] Additionally, Japanese Patent Laid-Open Pub- 
lication No. 2001 -1 031 88 cuts down a terminal cost by 
arranging a decoding capability for barcode data on a . 45 
server which is connected to a terminal via a communi- -. 
cations line, and by transmitting a barcode image itself 
to the server to process the image. 
[0009] As described above, in the conventional exam- 
ple, an image process and a barcode data decoding so 
process are performed by the MPU and the memory of 
a device itself. Therefore, if an input image is a large 
screen image, and a complex image process is per- 
formed when barcode data is attempted to be captured 
with a terminal having a processor of low throughput like 55 
a portable terminal, processing time increases. As a re- 
sult, more of the computing power of the MPU is re- 
quired, or the processes themselves cannot be per- 



formed due to a limitation on a memory area. Addition- 
ally, since also the software which performs a process 
specific to a barcode image is installed in the device it- 
self, hardware resources such as a memory for storing 
the software becomes necessary, leading to an increase 
in the device cost. 

[0010] If a decoding process for barcode data is per- 
formed by a server as disclosed by Japanese Patent 
Laid-Open Publication No. 2001-103188, a barcode im- 
age is transmitted as such. Therefore, the amount of 
communication data is large, so that communication 
cost and time increase. Furthermore, a result of the bar- 
code process is not transmitted to a terminal or other 
devices. Especially, on the side of a terminal directly 
used by a user, barcode data or its associated informa- 
tion cannot be used. 

[0011] It is desirable to provide an image data 
processing device capable of quickly performing, com- 
plex image and information processes, even if the 
throughput (computing power or a memory space) of a 
device having an image input device is low, or software 
which performs a process specific to a barcode image, 
or the like is not installed. 

[0012] It is also desirable to provide an image data 
processing device and a method thereof, with which a 
terminal user or a third party can freely use barcode data 
from which a process result is obtained, and its associ- 
ated information. 

[0013] An image data processing device according to 
an embodiment of a first aspect of the present invention 
comprises: an image data inputting unit inputting an im- 
age including coded data; a preprocessing unit perform- 
ing a preprocess for the image; an image data transmit- 
ting unit transmitting the image data for which the pre- 
process is performed to a server that performs an image 
process via a communications path; and a process re- 
sult receiving unit receiving the data resultant from the 
image process performed by the server via the commu- 
nications path. 

[0014] An image data processing method according 
to an embodiment of a second aspect of the present in- 
vention comprises: an image data inputting step input- 
ting an image including coded data; a preprocessing 
step performing a preprocess for the image; an image 
data transmitting step transmitting the image data for 
which the preprocess is performed to a server that per- 
forms an image process via a communications path ; and 
a process result receiving step receiving the data result- 
ant from the image process performed by the server via 
the communications path. 

[0015] In an embodiment of the present invention, af- 
ter a preprocess is performed for an image, which is ob- 
tained by an image data processing device such as a 
cellular phone equipped with a camera, the image is 
transferred to a server that is connected via a commu- 
nications path and performs an image process. Then, 
the server is made to perform the image process, and 
only a result of the image process is received by the im- 
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age data processing device. Therefore, the amount of 
data becomes small at an image transfer, and the data 
can be quickly transferred. At the same time, a main 
process in the image process is performed by a server 
the throughput of which is high. Therefore, a result ob- 5 
tained by performing a desired data process can be 
quickly obtained even if the computing power or the 
memory space of the image data processing device is 
insufficient. 

[0016] Reference will now be made, by way of exam- 10 
pie, to the accompanying drawings, in which: 

Fig. 1 exemplifies the configuration of a convention- 
al image input processing device such as a barcode 
reader; 

Fig. 2 shows a first preferred embodiment accord- 
ing to the present invention; 

Fig. 3 shows the outline of processes performed by 
devices in the first preferred embodiment according 
to the present invention; 

Fig. 4 shows a second preferred embodiment ac- 
cording to the present invention; 
Fig. 5 shows the outline of processes performed by 
devices in the second preferred embodiment ac- 
cording to the present invention; 
Fig. 6 shows a third preferred embodiment; 
Fig. 7 shows the outline of processes performed by 
devices in the third preferred embodiment accord- 
ing to the present invention; 

Fig. 8 shows afourth preferred embodiment accord- 
ing to the present invention; 

Fig. 9 shows the outline of processes performed by 
devices in the fourth preferred embodiment accord- 
ing to the present invention; 

Fig. 10 shows a fifth preferred embodiment accord- 
ing to the present invention; and 
Fig. 11 shows the outline of processes performed 
by devices in the fifth preferred embodiment ac- 
cording to the present invention. 

[0017] An image data processing device according to 
a preferred embodiment of the present invention is con- 
figured by: a first device having an information inputting 
unit inputting image information including coded data, a 
data transferring unit transferring the input data, and a 
process result receiving unit receiving a process result 
from a second device; and the second device having a 
data receiving unit receiving data, a data processing unit 
performing a process for the data, and a process result 
transmitting unit transmitting a result of the data 
processing unit to the first device. The first and the sec- 
ond devices are connected by a communications path, 
and mutually transmit/receive data. 
[0018] Or, the image data processing device is con- 
figured by: a first device having an information inputting 
unit inputting image information including coded data, a 
data transferring unit transferring input data, and a proc- 
ess result receiving unit receiving a process result from 



a second device; and a second device having a data 
receiving unit receiving data, a data processing unit per- 
forming a process for the data, and a process result 
transmitting unit transmitting a result of the data 
processing unif to the first device. The first and the sec- 
ond devices are connected by a communications path, 
and mutually transmit/receive information. At the same 
time, information according to a result of the image 
processing unit within the second device is transmitted/ 
received to/from a third device connected by a commu- 
nications path. 

[0019] Or, the image data processing device is con- 
figured by: a first device having an information inputting 
unit inputting image information including coded data, a 
data transferring unit transferring input data, and a proc- 
ess result receiving unit receiving a process result from 
a second device; and a second device having a data 
receiving unit receiving data, a data processing unit per- 
forming a process for the data, and a process result 
transmitting unit transmitting a result of the data 
processing unit to the first device. The first and the sec- 
ond devices are connected by a communications path, 
and mutually transmit/receive information. 
[0020] The outline of the preferred embodiment ac- 
cording to the present invention is explained below. 
[0021] First of all, a method applied in the case where 
an image whose data amount is large is obtained by a 
device (the first device) whose data throughput is rela- 
tively low, such as a camera, etc. is described:- 
[0022] Firstly, a barcode is input by the camera (the 
first device), an image process and barcode decoding 
are performed by asecond device (an image processing 
server (a data processing device whose data throughput 
is high, and can transmit/receive data to/from the cam- 
era (the first device) via a communications path)), and 
information corresponding to the coded data stored in 
the barcode is received by the camera (the first device). 
[0023] Image data is transmitted from the first device 
(the camera, a cellular phone, etc.) equipped' with an 
image input device, whose available memory is limited, 
to the second processing device which is connected by 
a communications path and has a large memory, and a 
process result is obtained. In this way, an image process 
which requires a large memory can be performed even 
if the first device equipped with the image input device 
can be used with only a small memory. 
[0024] Conventionally, in the first device such as a 
. camera, a cellular phone, etc., a barcode image process 
and a barcode decoding process are performed in a bar- 
code image process, and coded data stored in a bar- 
code is extracted. A software library of 1 00 KB or more 
is required respectively for the barcode image process 
and the barcode decoding process. If a grayscale image 
of a CIF (Common Intermediate Format) size (352 by 
288 pixels) is used as a barcode image, only this image 
requires 100-KB of memory. 

[0025] The case where a cellular phone equipped with 
a camera is assumed to be used for a barcode process 
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is considered. For the cellular phone, its computing pow- 
er and memory area are mainly used for the transmis- 
sion/reception of a telephone call, and a telephone book 
capability for telephone numbers. For an image input 
and an image process, an empty space is used, and the 5 
amount of available memory is limited to several hun- 
dred KB. Accordingly, an image process which requires 
a large memory, such as a barcode process, cannot be 
performed by the cellular phone alone. 
[0026] In the meantime, an image server connected 10 
by a communications line can perform a barcode proc- 
ess, since it can be used with a high processing speed 
and a memory required for the process. Additionally, a 
software library of a barcode image process, a barcode 
decoding process, etc. is installed on the image server, 15 
thereby eliminating the need for storing the software li- 
brary in the memory of the cellular phone. 
[0027] Accordingly, data is transmitted/received be- 
tween the cellular phone equipped with the camera and 
the image processing server via a communications line, 20 
whereby the image process which requires a large 
memory can be implemented. 

[0028] The shortening of a communication time be- 
tween the first and the second devices is described next. 
[0029] A barcode is input by the first device such as 25 
a camera, etc., an image process and barcode decoding 
are performed by the second device (image processing 
server) , and coded data stored in the barcode is extract- 
ed and transmitted as such to the third device. If the first 
device equipped with an image input device transmits 30 
image data to the second processing device, and issues 
a request to perform a process to the third device con- 
nected by a communications path according to a proc- 
ess result, the process result of the second device is 
directly transmitted from the second device to the third 35 
device instead of transmitting the process result of the 
second device to the first device, which then issues the 
request to perform the process to the third device. As a 
result, a communication means can be simplified and 
made faster. 40 
[0030] If shooting is made by a cellular phone 
equipped with a camera, the speeds of the communica- 
tions paths between the first and the second devices, 
and between the first and the third devices are up to 1 .2 
KB/s (9600 bps: the communication speed of the cellular *5 
phone), whereas the communication speed of the sec- 
ond and the third devices, which are connected by the 
Internet, is 180 KB/s (1.5 Mbps: the communication 
speed of the third terminal (PC) connected to the Inter- 
net. ADSL in this case) . A big difference exists between so 
the communication speeds. 

[0031] If coded data is returned from the second de- 
vice to the first device, it must be retransmitted from the 
first device to the third device that performs a database 
process so as to extract corresponding information. At 55 
this time, supplementary data such as the network ad- 
dress of the third device, etc. , which must be obtained 
from the second device, exist, and a communication 



amount on a low-speed communications path increas- 
es. 

[0032] Accordingly, the coded data and the network 
address of the first device are directly transferred from 
the second device to the third device, corresponding in- 
formation is prepared, and a process result is returned 
to the first device, so that an excess communication 
amount can be reduced. 

[0033] Measures to speed up a communication proc- 
ess by performing a preprocess in a terminal is de- 
scribed below. 

[0034] If a barcode is input by a camera, etc. (the first 
device), and a barcode image process and a barcode 
decoding process are performed by the second device 
(image processing server), grayscale image data input 
by the first device is transferred to the second device, 
by which the barcode image process and the barcode 
data decoding process are performed to extract coded 
data stored in the barcode. Here, in a preprocess within 
the barcode image process of the second device, an im- 
age binarization process whose processing load is light 
is performed by the first device, and not the grayscale 
image data but the binarized image data is transferred 
to the second device. 

[0035] Part of the barcode image process that the • 
second device is requested to perform is performed on 
the side of the first device equipped with an image input 
device, whereby the load on the second processing de- 
vice ca be lightened, a transfer data size can be re- 
duced, and a communication processing time can be 
shortened. 

[0036] An image binarization process is approximate- 
ly 5 percent of the whole of the barcode image process 
and the barcode decoding process. Process requests 
reach the server simultaneously from a plurality of first 
devices. In the case of a server that can simultaneously 
process requests from 20 first devices, the image bina- 
rization process is performed by the first devices before- 
hand, so that the server can simultaneously process the 
requests from the 20 first devices or more, leading to an 
increase in the speed of the server process. Additionally, 
the binarization process is performed by the first device, 
whereby a transfer image data size can be reduced to 
approximately 1/8 from 100 KB to 12 KB. If the commu- 
nications path between the first and the second devices 
has a transmission speed of 1.2 KB/s (9600 bps), the 
transmission/reception time of 80 seconds is reduced to 
10 seconds, which is 1/8, for grayscale image data. That 
is, 8-times high-speed transfer can be implemented. 
[0037] Furthermore, measures to speed up a commu- 
nication by performing a partial extraction process in a 
first terminal (the first device) is described below. 
[0038] If a barcode is input by a camera, etc. (the first 
device), and a barcode image process and a barcode 
decoding process are performed by the second device 
(image processing server), grayscale image data input 
by the first device is transferred to the second device, 
by which the barcode image process and the barcode 
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decoding process are performed to extract coded data 
stored in the barcode. Here, a process for extracting a 
portion from the barcode image data is performed by the 
first device, and the extracted portion is transferred to 
the second device. 

[0039] As a result, a transfer data size can be re- 
duced, and a communication processing time can be 
shortened. 

[0040] In case of a barcode, especially, a one-dimen- 
sional barcode, a decoding process can be performed 
if there is at least data obtained by extracting a barcode 
symbol portion by one horizontal line. A portion of 352 
by 1 pixels, which corresponds to the one horizontal line 
of the barcode symbol portion, is extracted from mono- 
chrome image data of the CIF (352 by 288 pixels) size, 
and transferred, so that a transfer image data size can 
be reduced to 1/288 from 100 KB to 0.3 KB of the gray- 
scale image data. However, decoding is unsuccessfully 
performed in some cases only with such an extracted 
portion. At this time, an instruction to extract and trans- 
mit another portion is issued from the second device to 
the first device. If decoding is successfully performed 
even after a transmission is repeated by n (1<n<288) 
times, a transfer image data size can be reduced to n/ 
288. Additionally, instead of extracting another portion, 
a threshold value for the binarization process, which is 
performed by the first device, may be changed, and bi- 
narized image data may be transmitted to the second 
device. 

[0041] Furthermore, measures to speed up a commu- 
nication by performing an image compression process 
in a terminal is explained. 

[0042] BMP compression (Japanese Patent Laid- 
Open Publication No. Hei 8-51 545) is performed for data 
transmitted between the first device equipped with an 
image input device, and the second device that per- 
forms an image process, whereby transmission data 
can be reduced, and a communication time can be 
shortened. 

[0043] The BMP compression is a bitmap data com- 
pression method (for further details, refer to Japanese 
Patent Laid-Open Publication No. Hei 8-51545), which 
can implement efficient data compression with a simple 
algorithm without requiring special hardware at a bitmap 
data transfer. For example, monochrome binary image 
data of the CIF size can be compressed to approximate- 
ly 1/50 or smaller. Additionally, a compression/decom- 
pression process can be quickly performed in approxi- 
mately 0.2 seconds. If the transmission speed of the 
communications path between the first and the second 
devices is 1.2 KB/s (9600 bps), transmission/reception 
time of 10 seconds in the case where an image is not 
compressed is reduced to 1/50 in the case where the 
image is compressed. Therefore, this 0.2 seconds plus 
the compression/decompression process time of 0.2 
seconds is 0.4 seconds in total, which can implement 
25-times speed-up. 

[0044] A specific explanation is provided below with 



reference to the drawings. 

[0045] In preferred embodiments, a process for a 
monochrome image is explained. For a color image, its 
monochrome image can be simply obtained if only lumi- 
5 nance information is extracted from color information of 
a pixel. Therefore, the following preferred embodiments 
are applicable also to a color image. 
[0046] Fig. 2 shows a first preferred embodiment ac- 
cording to the present invention, whereas Fig. 3 shows 
10 the outline of processes performed by devices. 

[0047] In Fig. 2, a first device 20 such as a portable 
terminal equipped with an image input capability obtains 
image data. This obtainment is made by an image data 
inputting unit 22. The image data obtained by the image 
15 data inputting unit 22 is transmitted to an image data 
transmitting unit 23, and further transmitted to a second 
device 21 such as an image processing server, etc. via 
a communications path 29. The image data from the first 
device 20 is received by an image data receiving unit 
26 within the second device 21 , and the received image 
data is transmitted to a data processing unit 27. In the 
data processing unit 27, a barcode decoding process, 
etc., is performed. A result of the data process per- 
formed by the data processing unit 27 is transmitted to 
a process result transmitting unit 28, and further trans- 
mitted to the first device 20 via the communications path 
29. In the first device 20, the transmitted process result 
is received by a process result receiving unit24;'passed 
to a process result outputting unit 25, and presented to 
a user of the first device 20 on a display (not shown). 
[0048] Namely, image data input from the image data 
inputting unit such as a CMOS, a CCD sensor, etc., 
which is equipped by the first device, is transmitted to 
the second device connected by a communications path 
via the data transmitting unit. The image data received 
by the second device is held by the image data receiving 
unit. An image process, which is prespecified by the da- 
ta processing unit (here, the barcode image process and 
the barcode decoding process), is performed for the 
held image data, and its result is transmitted to the proc- 
ess result transmitting unit. The result data is further 
transmitted to the first device via the communications 
path, and input to the process result outputting unit with- 
in the first device. In the first device, ah image process 
result (coded data) can be obtained without performing 
an actual image process. 

[0049] The flow of data is described more specifically 
with reference to Fig. 3. If a barcode is input as an image 
by a camera equipped by a cellular phone ((1)), this 
does not has any sense as it is. A process (decoding 
process) for converting the barcode image into coded 
data such as a numeral, a character, etc. embedded in 
the barcode, and for extracting the coded data from the 
barcode is required. Therefore, the image data is trans- 
mitted to the second device ((2)), and an image process 
and a decoding process, which are intended to convert 
the image data into coded data such as a numeral, a 
character, etc., are performed ((3) and (4)). In this pre- 
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ferred embodiment, the image process and the decod- 
ing process are performed by the second device (image 
processing server) connected by a communications 
path. In the second device (image processing server) , 
an image process such as a binarization process, a bar- s 
code area extraction process, etc. is performed for the 
received image data, and then, the decoding process is 
performed. Coded data resultant from the decoding 
process is returned to the transmission source ((5)). In 
the first device, the coded data returned from the second 10 
device (image processing server) is displayed on a 
screen, so that the contents of the barcode can be dis- 
played. For a barcode, its coded data itself does not 
have a sense, and information that is stored in a data- 
base, etc. and corresponded to the coded data is more 15 
important and has a sense in many cases. Therefore, 
the information may be converted by the second device 
(image processing server), and the information corre- 
sponded to the coded data may be returned to the first 
device. 20 
[0050] Fig. 4 shows a second preferred embodiment 
according to the present invention, whereas Fig. 5 
shows the outline of processes performed by devices. 
[0051] As shown in Fig. 4, if a first device 20 equipped 
with an image input device transmits image data to a 25 
second device 21, and issues a request to perform a 
process to a third device 30 connected by a communi- 
cations path according to a process result, the process 
result of the second device 21 is directly transmitted to 
the third device 30 instead of issuing the request from 30 
the first device 20 to the third device 30. As a result, a 
communication means from the second device 21 to the 
first device 20 is simplified and made faster. 
[0052] As shown in Fig. 5, a barcode image is input 
by the first device ((1 )), barcode decoding is performed 35 
by the second device (image processing server) ((3) and 
(4)), and coded data is transmitted to the third device, 
which is a database processing device ((5)). Then, in- 
formation corresponding to the coded data is extracted 
by the third device ((6)). If an output device such as a 40 
monitor, etc. is comprised by the third device, the infor- 
mation corresponding to the coded data can be verified 
on its screen. Or, if this information is verified by the first 
device, it is directly transmitted from the third device to 
the first device ((7)). 

[0053] As described above, it achieves a simpler com- 
munication than the first embodiment in which only an 
image process ( barcode decoding) is performed and 
the returned code data is returned to the third device 
again. 

[0054] Fig. 6 shows a third preferred embodiment ac- 
cording to the present invention, whereas Fig. 7 shows 
the outline of processes performed by devices. 
[0055] In Fig. 6, the same constituent elements as 
those shown in Fig. 2 are denoted with the same refer- 
ence numerals, and their explanations are omitted. 
[0056] Within a first device 20, a preprocessing unit 
40, which performs a preprocess in an image process 



performed for image data, is arranged between an im- 
age data inputting unit 22 and an image data transmit- 
ting unit 23. In the preprocessing unit 40, for example, 
a process for extracting a portion from image data is per- 
formed, and the extracted portion is transferred to a sec- 
ond device 21. As a result, a transfer data size can be 
reduced, and a communication processing time can be 
shortened. Or, binarization may be performed as the 
preprocess. If a data processing unit 27 within the sec- 
ond device 21 fails to process the image data transmit- 
ted from the first device 20, it issues a request to extract 
. and retransmit another portion to the preprocessing unit 
40 within the first device 20 via a communications path 
(in the case where the process for extracting a portion 
from image data is performed as the preprocess). Or, in 
the case where binarization is performed as the preproc- 
ess, the data processing unit 27 within the second de- 
vice 21 issues a request to retransmit a new binary im- 
age, which is obtained by changing a threshold value 
used for the binarization to a different value, to the pre- 
processing unit 40 within the first device 20 if it fails to 
process the image data. 

[0057] Assume that barcode image data is input by 
the first device ((1)), and the process for extracting a 
portion from the barcode image data is performed as a' 
preprocess ((2)) as shown in Fig. 7. In this case, the 
extracted barcode image data is transferred to the sec- 
ond device (image processing device) ((3)), by which an 
image process and a barcode decoding process are 
performed ((4) and (5)). If the barcode decoding process 
is unsuccessfully performed, an instruction to extract 
and retransmit another portion of the image data is is- 
sued from the second device (image processing device) 
to the first device (cellular phone equipped with a cam- 
era ((5')). When the barcode decoding process is suc- 
cessfully performed, resultant coded data is returned to 
the cellular phone equipped with the camera ((6)). 
[0058] Fig. 8 shows a fourth preferred embodiment 
according to the present invention, whereas Fig. 9 
shows the outline of processes performed by devices. 
[0059] In Fig. 8, the same constituent elements as 
those shown in Fig. 6 are denoted with the same refer- 
ence numerals, and their explanations are omitted. 
[0060] As shown in Fig. 8, a data compressing unit 50 
and a data decompressing unit 51, which are intended 
to compress and decompress transmission data in a da- 
ta transmission made by a communications path 29 that 
connects a first device 20 and a second device 21 , are 
arranged, whereby the amount of transmission data is 
so reduced, and a communication time is shortened. 

[0061] As shown in Fig. 9, a BMC coding method is 
used as an image data compression process in order to 
shorten an image data transmission time for an image 
process and a barcode decoding process, and image 
55 data to be transmitted/received is compressed, thereby 
shortening the transmission/reception time between the 
devices. 

[0062] That is, in a cellular phone equipped with a 
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camera (the first device), a barcode image is captured 
((1)), and the input image is compressed by the BMC 
compression/decompression capability of the cellular 
phone equipped with the camera. Then, the com- 
pressed image data is transmitted to the second device 
(image processing device) via a communications line 
((2)). In the image processing device, upon receipt of 
the compressed image, the image is decompressed, 
and an image data process is performed ((3)). in Fig. 9, 
binarization and area extraction are performed as the 
image process . However, these processes may be per- 
formed on the side of the first device. The barcode of 
the barcode image for which the image process is per- 
formed is decoded ((4)), coded data is extracted, and 
the extracted coded data is transmitted to the cellular 
phone equipped with the camera as data resultant from 
the image process ((5)). 

[0063] An example where image binarization is per- 
formed as a preprocess, especially, an example where 
a two-dimensional barcode is handled is described be- 
low. 

[0064] Fig. 1 0 shows a fifth preferred embodiment ac- 
cording to the present invention, whereas Fig. 11 shows 
the outline of processes performed by devices. 
[0065] As coded data handled by the present inven- 
tion, a one-dimensional barcode, a two-dimensional 
barcode, or data according to the one-dimensional or 
the two-dimensional barcode is assumed. This pre- 
ferred embodiment refers to an example where a two- 
dimensional barcode is used. As a matter of course, the 
present invention is also applicable to a one-dimension- 
al barcode in a similar manner. 

[0066] In Fig. 10, the same constituent elements as 
those shown in Fig. 6 are denoted with the same refer- 
ence numerals, and their explanations are omitted. 
[0067] Within a first device 20, a preprocessing unit 
40, which performs a preprocess in an image process 
performed for image data, is arranged between an im- 
age data inputting unit 22 and an image data transmit- 
ting unit 23. A color or a grayscale image obtained by 
reading an original including a two-dimensional barcode 
is input from the image data inputting unit 22. In the pre- 
processing unit 40, a binarization process for reducing 
gray levels of image data is performed. As a binarization 
process technique, a technique using the characteristic 
of a two-dimensional barcode as disclosed by Japanese 
Patent Laid-Open Publication No. 2001-251 507 is used, 
so that the accuracy of a later decoding process, etc., 
can be improved. Additionally, by performing the binari- 
zation process, the size of image data is reduced to 1 /24 
(in the case where an original image is color). As a re- 
sult, a transfer data size can be reduced, a communica- 
c tion processing time can be shortened, and a commu- 

nication cost can be cut down. 

[0068] The image data that is binarized and trans- 
ferred to the second device 21 is transmitted to an image 
processing unit 27withinthe second device21 , by which 
an image process and a barcode decoding process are 



performed. As an image process, a process for extract- 
ing a two-dimensional barcode area, or the like is per- 
formed. The technique using the characteristic of a two- 
dimensional barcode as disclosed by Japanese Patent 
5 Laid-Open Publication No. 2001-307014 is used also 
here, whereby a two-dimensional barcode area can be 
extracted more securely, and also the accuracy of bar- 
code decoding is improved. 

[0069] Note that the process for extracting a two-di- 
10 mensional barcode area may be performed by a pre- 
processing unit 40 within the first device 20 as a pre- 
process. In this case, a transfer data size is further re- 
duced, so that a communication processing time can be 
shortened, and a communication cost can be cut down. 
15 However, the algorithm of the process for extracting a 
two-dimensional barcode area is complex. Therefore, if 
the throughput of the first device 20 is much lower than 
that of the second device 21 , an excess processing time 
is required, and can possibly exceed a shortened com- 
20 munication processing time. Accordingly, a process 
handled as the preprocess is suitably selected in con- 
sideration of the throughputs of the first device 20 and 
the second device 21 . 

[0070] In Fig. 1 1 , an image including atwo-dimension- 
25 al barcode is obtained from a cellular phone equipped ' 
with a camera, which is the first device ((1)). Then, a 
preprocess such as binarization of the obtained image, 
or the like is performed ((2)), and the image datais trans- 
mitted to an image processing device, which is the sec- 
30 ond device, via a communications line ((3)). In the image 
processing device, an image data process such as area 
extraction from the received image, or the like is per- 
formed ((4)), the two-dimensional barcode is decoded 
and converted into coded data ((5)), and the coded data 
35 resultant from the image process is returned to the cel- 
lular phone equipped with the camera via the commu-'** 
nications line ((6)). 

[0071] As described above, according to one embod- 
iment of the present invention, input image dataMnclud- 

40 ing coded data of a device having an image input device 
is transmitted to an image processing server, and a 
process result is obtained, whereby it becomes possible 
to provide an image data processing device, which 
quickly performs a process of an image including com- 

45 plex coded data and its information process, even if the 
throughput of the device having the image input device 
is low. 



so Claims 

1. An image data processing device, comprising: 

image data inputting means for inputting an im- 
55 age including coded data; 

preprocessing means for performing a preproc- 
ess for the image; 

image data transmitting means for transmitting 
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the image data for which the pre process is per- 
formed to a server that performs an image proc- 
ess via a communications path; and 
process result receiving means for receiving 
data resultant from the image process per- 5 
formed by the server via the communications 
path. 

2. The image data processing device according to 
claim 1, wherein w 

the preprocess is binarization of an image. 

3. The image data processing device according to 
claim 1, wherein 

the preprocess is a process for extracting a 15 
portion of an image. 

4. The image data processing device according to 
claim 1, wherein 

an image compression process is performed 20 
as the preprocess. 



5. The image data processing device according to any 
preceding claim, wherein 

the server is configured by a plurality of image 
processing devices, one of which performs part of 
a process for image data transmitted from the im- 
age data processing device, the other image 
processing devices share and perform a remainder 
of the process, and an obtained result is returned 
to the image data processing device. 

6. The image data processing device according to any 
preceding claim, wherein 

the server makes the image data processing 
device retransmit the image for which the preproc- 
ess is performed under a different condition, if the 
server fails to perform an image process for the im- 
age which is transmitted from the image data 
processing device, and the preprocess is per- 
formed for. 

7. The image data processing device according to 
claim 6, wherein 

the different condition indicates that a thresh- 
old value for binarization is changed to a different 
value, if the binarization is performed as the pre- 
process. 

8. The image data processing device according to 
claim 6, wherein 

the different condition is to extract a different 
portion of an image if image extraction is performed 
as the preprocess. 

9. The image data processing device according to any 
preceding claim, wherein 

the image including the coded data is an im- 



age including an image of a barcode. 

10. The image data processing device according to 
claim 9, wherein 

the barcode is a two-dimensional barcode. 



1 1 . An image data processing method of an image data 
processing device, comprising the steps of: 

inputting an image including coded data; 
performing a preprocess for the image; 
transmitting image data for which the preproc- 
ess is performed to a server that performs an 
image process via a communications path; and 
receiving data resultant from the image process 
performed by the server via the communica- 
tions path. 

12. The image data processing method according to 
claim 11, wherein 

the preprocess is binarization of an image. 

13. The image data processing method according to 
claim 1 1 , wherein 

the preprocess is a process for extracting a 
portion of an image. 



30 



14. The image data processing method according to 
claim 11, wherein 

an image compression process is performed 
as the preprocess. 



35 
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15. The image data processing method according to 
any one of claims 11 to 14, wherein 

the server is configured by a plurality of image 
processing devices, one of which performs part of 
a process for image data transmitted from an image 
data processing device, the other image processing 
devices share and perform a remainder of the proc- 
ess, and an obtained result is returned to the image 
data processing device. 

16. The image data processing method according to 
any one of claims 11 to 15, wherein 

if the server fails to process the image trans- 
mitted from said image data transmitting, for which 
the preprocess is performed, the server makes the 
image, for which the preprocess is performed under 
a different condition, retransmitted. 

17. The image data processing method according to 
claim 16, wherein 

the different condition indicates that a thresh- 
old value for binarization is changed to a different 
value, if the binarization is performed as the pre- 
process. 

18. The image data processing method according to 
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claim 16, wherein 

the different condition is to extract a different 
portion of an image if image extraction is performed 
as the preprocess. 

5 

19. The image data processing method according to 
any one of claims 11 to 18, wherein 

the image including the coded data is an im- 
age including an image of a barcode. 

10 

20. The image data processing method according to 
claim 19, wherein 

the barcode is a two-dimensional barcode. 

15 
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□ GRAY SCALE DOCUMENTS 
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□ OTHER: : — 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
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